Limit superior and limit inferior

In mathematics, the limit inferior (also called infimum limit, liminf, inferior limit, lower limit, or inner limit) and limit superior (also called supremum limit, limsup, superior limit, upper limit, or outer limit) of a sequence can be thought of as limiting (i.e., eventual and extreme) bounds on the sequence. The limit inferior and limit superior of a function can be thought of in a similar fashion (see limit of a function). The limit inferior and limit superior of a set are the infimum and supremum of the set's limit points, respectively. In general, when there are multiple objects around which a sequence, function, or set accumulates, the inferior and superior limits extract the smallest and largest of them; the type of object and the measure of size is context-dependent, but the notion of extreme limits is invariant.

Contents

Definition for sequences

The limit inferior of a sequence (xn) is defined by

\liminf_{n\to\infty}x_n�:= \lim_{n\to\infty}\Big(\inf_{m\geq n}x_m\Big)

or

\liminf_{n\to\infty}x_n�:= \sup_{n\geq 0}\,\inf_{m\geq n}x_m=\sup\{\,\inf\{\,x_m:m\geq n\,\}:n\geq 0\,\}.

Similarly, the limit superior of (xn) is defined by

\limsup_{n\to\infty}x_n�:= \lim_{n\to\infty}\Big(\sup_{m\geq n}x_m\Big)

or

\limsup_{n\to\infty}x_n�:= \inf_{n\geq 0}\,\sup_{m\geq n}x_m=\inf\{\,\sup\{\,x_m:m\geq n\,\}:n\geq 0\,\}.

Alternatively, the notations \varliminf_{n\to\infty}x_n:=\liminf_{n\to\infty}x_n and \varlimsup_{n\to\infty}x_n:=\limsup_{n\to\infty}x_n are sometimes used.

If the terms in the sequence are real numbers, the limit superior and limit inferior always exist, as real numbers or ±∞ (i.e., on the extended real number line). More generally, these definitions make sense in any partially ordered set, provided the suprema and infima exist, such as in a complete lattice.

Whenever the ordinary limit exists, the limit inferior and limit superior are both equal to it; therefore, each can be considered a generalization of the ordinary limit which is primarily interesting in cases where the limit does not exist. Whenever lim inf xn and lim sup xn both exist, we have

\liminf_{n\to\infty}x_n\leq\limsup_{n\to\infty}x_n.

Limits inferior/superior are related to big-O notation in that they bound a sequence only "in the limit"; the sequence may exceed the bound. However, with big-O notation the sequence can only exceed the bound in a finite prefix of the sequence, whereas the limit superior of a sequence like e-n may actually be less than all elements of the sequence. The only promise made is that some tail of the sequence can be bounded by the limit superior (inferior) plus (minus) an arbitrarily small positive constant.

The limit superior and limit inferior of a sequence are a special case of those of a function (see below).

The case of sequences of real numbers

In mathematical analysis, limit superior and limit inferior are important tools for studying sequences of real numbers. Since the supremum and infimum of an unbounded set of real numbers may not exist (the reals are not a complete lattice), it is convenient to consider sequences in the affinely extended real number system: we add the positive and negative infinities to the real line to give the complete totally ordered set [-∞,∞], which is a complete lattice.

Interpretation

Consider a sequence (x_n) consisting of real numbers. Assume that the limit superior and limit inferior are real numbers (so, not infinite).

Properties

The relationship of limit inferior and limit superior for sequences of real numbers is as follows

-\liminf_{n\to\infty} x_n = \limsup_{n\to\infty} (-x_n).

As mentioned earlier, it is convenient to extend R to [−∞,∞]. Then, (xn) in [−∞,∞] converges if and only if

\liminf_{n\to\infty} x_n = \limsup_{n\to\infty} x_n,

in which case \lim_{n\to\infty} x_n is equal to their common value. (Note that when working just in R, convergence to −∞ or ∞ would not be considered as convergence.) Since the limit inferior is at most the limit superior, the condition

\liminf_{n\to\infty} x_n = \infty

implies that

\lim_{n\to\infty} x_n = \infty,

and the condition

\limsup_{n\to\infty} x_n = - \infty

implies that

\lim_{n\to\infty} x_n = - \infty.

If

I = \liminf_{n\to\infty} x_n

and

S = \limsup_{n\to\infty} x_n,

then the interval [I, S] need not contain any of the numbers xn, but every slight enlargement [I − ε, S + ε] (for arbitrarily small ε > 0) will contain xn for all but finitely many indices n. In fact, the interval [I, S] is the smallest closed interval with this property. We can formalize this property like this. If there exists a \Lambda\in\mathbb{R} so that

\Lambda<\limsup_{n\to\infty}x_n

then there exists a subsequence x_{k_n} of x_n for which we have that

x_{k_n}>\Lambda\quad \forall n.

In the same way, an analogous property holds for the limit inferior: if

\liminf_{n\to\infty}x_n<\lambda

then there exists a subsequence x_{k_n} of x_n for which we have that

x_{k_n}<\lambda\quad\forall n.

On the other hand we have that if

\limsup_{n\to\infty}x_n<\Lambda

there exists a n_0\in\mathbb{N} so that

x_n<\Lambda\quad\forall n\geq n_0.

Similarly, if there exists a \lambda\in \mathbb{R} so that

\lambda<\liminf_{n\to\infty}x_n

there exists a n_0\in\mathbb{N} so that

x_n>\lambda\quad\forall n\geq n_0.

To recapitulate:

In general we have that

\inf_n x_n \leq \liminf_{n \to \infty} x_n \leq \limsup_{n \to \infty} x_n \leq \sup_n x_n

The liminf and limsup of a sequence are respectively the smallest and greatest cluster points.

\limsup_{n \to \infty} (a_n %2B b_n) \leq \limsup_{n \to \infty}(a_n) %2B \limsup_{n \to \infty}(b_n)..

Analogously, the limit inferior satisfies superadditivity:

\liminf_{n \to \infty} (a_n %2B b_n) \geq \liminf_{n \to \infty}(a_n) %2B \liminf_{n \to \infty}(b_n).

In the particular case that one of the sequences actually converges, say a_n \to a , then the inequalities above become equalities (with \limsup_{n \to \infty}a_n or \liminf_{n \to \infty}a_n being replaced by a).

Examples

\liminf_{n\to\infty} x_n = -1

and

\limsup_{n\to\infty} x_n = %2B1.

(This is because the sequence {1,2,3,...} is equidistributed mod 2π, a consequence of the Equidistribution theorem.)

\liminf_{n\to\infty}(p_{n%2B1}-p_n),

where pn is the n-th prime number. The value of this limit inferior is conjectured to be 2 - this is the twin prime conjecture - but as yet has not even been proved finite. The corresponding limit superior is %2B\infty, because there are arbitrary gaps between consecutive primes.

Real-valued functions

Assume that a function is defined from a subset of the real numbers to the real numbers. As in the case for sequences, the limit inferior and limit superior are always well-defined if we allow the values +∞ and -∞; in fact, if both agree then the limit exists and is equal to their common value (again possibly including the infinities). For example, given f(x) = sin(1/x), we have lim supx0 f(x) = 1 and lim infx0 f(x) = -1. The difference between the two is a rough measure of how "wildly" the function oscillates, and in observation of this fact, it is called the oscillation of f at a. This idea of oscillation is sufficient to, for example, characterize Riemann-integrable functions as continuous except on a set of measure zero [1]. Note that points of nonzero oscillation (i.e., points at which f is "badly behaved") are discontinuities which, unless they make up a set of zero, are confined to a negligible set.

Functions from metric spaces to metric spaces

There is a notion of lim sup and lim inf for functions defined on a metric space whose relationship to limits of real-valued functions mirrors that of the relation between the lim sup, lim inf, and the limit of a real sequence. Take metric spaces X and Y, a subspace E contained in X, and a function f : E → Y. The space Y should also be an ordered set, so that the notions of supremum and infimum make sense. Define, for any limit point a of E,

\limsup_{x \to a} f(x) = \lim_{\varepsilon \to 0} ( \sup \{ f(x)�: x \in E \cap B(a;\varepsilon) - \{a\} \} )

and

\liminf_{x \to a} f(x) = \lim_{\varepsilon \to 0} ( \inf \{ f(x)�: x \in E \cap B(a;\varepsilon) - \{a\} \} )

where B(a;ε) denotes the metric ball of radius ε about a.

Note that as ε shrinks, the supremum of the function over the ball is monotone decreasing, so we have

\limsup_{x\to a} f(x)  = \inf_{\varepsilon > 0} (\sup \{ f(x)�: x \in E \cap B(a;\varepsilon) - \{a\} \})

and similarly

\liminf_{x\to a} f(x) = \sup_{\varepsilon > 0}(\inf \{ f(x)�: x \in E \cap B(a;\varepsilon) - \{a\} \}).

This finally motivates the definitions for general topological spaces. Take X, Y, E and a as before, but now let X and Y both be topological spaces. In this case, we replace metric balls with neighborhoods:

\limsup_{x\to a} f(x) = \inf \{ \sup \{ f(x)�: x \in E \cap U - \{a\} \}�:  U\ \mathrm{open}, a \in U, E \cap U - \{a\} \neq \emptyset  \}
\liminf_{x\to a} f(x) = \sup \{ \inf \{ f(x)�: x \in E \cap U - \{a\} \}�:  U\ \mathrm{open}, a \in U, E \cap U - \{a\} \neq \emptyset  \}

(there is a way to write the formula using a lim using nets and the neighborhood filter). This version is often useful in discussions of semi-continuity which crop up in analysis quite often. An interesting note is that this version subsumes the sequential version by considering sequences as functions from the natural numbers as a topological subspace of the extended real line, into the space (the closure of N in [-∞, ∞] is N ∪ {∞}.)

Sequences of sets

The power set ℘(X) of a set X is a complete lattice that is ordered by set inclusion, and so the supremum and infimum of any set of sets, in terms of set inclusion, of subsets always exist. In particular, every subset Y of X is bounded above by X and below by the empty set ∅ because ∅ ⊆ YX. Hence, it is possible (and sometimes useful) to consider superior and inferior limits of sequences in ℘(X) (i.e., sequences of subsets of X).

There are two common ways to define the limit of sequences of set. In both cases:

The difference between the two definitions involves the topology (i.e., how to quantify separation) is defined. In fact, the second definition is identical to the first when the discrete metric is used to induce the topology on X.

General set convergence

In this case, a sequence of sets approaches a limiting set when the elements of each member of the sequence approach the elements of the limiting set. In particular, if {Xn} is a sequence of subsets of X, then:

The limit lim Xn exists if and only if lim inf Xn and lim sup Xn agree, in which case lim Xn = lim sup Xn = lim inf Xn.[1]

Special case: discrete metric

In this case, which is frequently used in measure theory, a sequence of sets approaches a limiting set when the limiting set includes elements from each of the members of the sequence. That is, this case specializes the first case when the topology on set X is induced from the discrete metric. For points xX and yX, the discrete metric is defined by

d(x,y)�:= \begin{cases} 0 &\text{if } x = y,\\ 1 &\text{if } x \neq y. \end{cases}

So a sequence of points {xk} converges to point xX if and only if xk = x for all but finitely many k. The following definition is the result of applying this metric to the general definition above.

If {Xn} is a sequence of subsets of X, then:

The limit lim X exists if and only if lim inf X and lim sup X agree, in which case lim X = lim sup X = lim inf X.[2] This definition of the inferior and superior limits is relatively strong because it requires that the elements of the extreme limits also be elements of each of the sets of the sequence.

Using the standard parlance of set theory, consider the infimum of a sequence of sets. The infimum is a greatest lower bound or meet of a set. In the case of a sequence of sets, the sequence constituents meet at an set that is somehow smaller than each constituent set. Set inclusion to provides an ordering that allows set intersection to generate a greatest lower bound ∩Xn of sets in the sequence {Xn}. Similarly, the supremum, which is the least upper bound or join, of a sequence of sets is the union ∪Xn of sets in sequence {Xn}. In this context, the inner limit lim inf Xn is the largest meeting of tails of the sequence, and the outer limit lim sup Xn is the smallest joining of tails of the sequence.

I_n�:= \inf \{ X_m�: m \in \{n, n%2B1, n%2B2, \ldots\}\} = \bigcap_{m=n}^{\infty} X_m = X_n \cap X_{n%2B1} \cap X_{n%2B2} \cap \cdots.
Then IkIk+1Ik+2 because Ik+1 is the intersection of fewer sets than Ik. In particular, the sequence {Ik} is non-decreasing. So the inner/inferior limit is the least upper bound on this sequence of meets of tails. In particular,
\begin{align}
\liminf_{n\to\infty}X_n &:= \lim_{n\to\infty} \inf\{X_m: m \in \{n, n%2B1, \ldots\}\}\\
&= \sup\{\inf\{X_m: m \in \{n, n%2B1, \ldots\}\}: n \in \{1,2,\dots\}\}\\
&= {\bigcup_{n=1}^\infty}\left({\bigcap_{m=n}^\infty}X_m\right).
\end{align}
So the superior limit acts like a version of the standard supremum that is unaffected by set elements that occur only finitely many times. That is, the superemum limit is a set that is a superset (i.e., an upper bound) for all but finitely many elements.
J_m�:= \sup \{ X_m�: m \in \{n, n%2B1, n%2B2, \ldots\}\} = \bigcup_{m=n}^{\infty} X_m = X_n \cup X_{n%2B1} \cup X_{n%2B2} \cup \cdots.
Then JkJk+1Jk+2 because Jk+1 is the union of fewer sets than Jk. In particular, the sequence {Jk} is non-increasing. So the outer/superior limit is the greatest lower bound on this sequence of joins of tails. In particular,
\begin{align}
\limsup_{n\to\infty}X_n &:= \lim_{n\to\infty} \sup\{X_m: m \in \{n, n%2B1, \ldots\}\}\\
&= \inf\{\sup\{X_m: m \in \{n, n%2B1, \ldots\}\}: n \in \{1,2,\dots\}\}\\
&= {\bigcap_{n=1}^\infty}\left({\bigcup_{m=n}^\infty}X_m\right).
\end{align}
So the inferior limit acts like a version of the standard infimum that is unaffected by set elements that occur only finitely many times. That is, the infimum limit is a set that is a subset (i.e., a lower bound) for all but finitely many elements.

The limit lim Xn exists if and only if lim sup Xn=lim inf Xn, and in that case, lim Xn=lim inf Xn=lim sup Xn. In this sense, the sequence has a limit so long as all but finitely many of its elements are equal to the limit.

Examples

The following are several set convergence examples. They have been broken into sections with respect to the metric used to induce the topology on set X.

Using the discrete metric
Using either the discrete metric or the Euclidean metric
\{X_n\} = \{ \{0\},\{1\},\{0\},\{1\},\{0\},\{1\},\dots \}.
The "odd" and "even" elements of this sequence form two subsequences, {{0},{0},{0},...} and {{1},{1},{1},...}, which have limit points 0 and 1, respectively, and so the outer or superior limit is the set {0,1} of these two points. However, there are no limit points that can be taken from the {Xn} sequence as a whole, and so the interior or inferior limit is the empty set {}. That is,
  • lim sup Xn = {0,1}
  • lim inf Xn = {}
However, for {Yn} = {{0},{0},{0},...} and {Zn} = {{1},{1},{1},...}:
  • lim sup Yn = lim inf Yn = lim Yn = {0}
  • lim sup Zn = lim inf Zn = lim Zn = {1}
\{X_n\} = \{ \{50\}, \{20\}, \{-100\}, \{-25\}, \{0\},\{1\},\{0\},\{1\},\{0\},\{1\},\dots \}.
As in the previous two examples,
  • lim sup Xn = {0,1}
  • lim inf Xn = {}
That is, the four elements that do not match the pattern do not affect the lim inf and lim sup because there are only finitely many of them. In fact, these elements could be placed anywhere in the sequence (e.g., at positions 100, 150, 275, and 55000). So long as the tails of the sequence are maintained, the outer and inner limits will be unchanged. The related concepts of essential inner and outer limits, which use the essential supremum and essential infimum, provide an important modification that "squashes" countably many (rather than just finitely many) interstitial additions.
Using the Euclidean metric
\{X_n\} = \{ \{0\},\{1\},\{1/2\},\{1/2\},\{2/3\},\{1/3\}, \{3/4\}, \{1/4\}, \dots \}.
The "odd" and "even" elements of this sequence form two subsequences, {{0},{1/2},{2/3},{3/4},...} and {{1},{1/2},{1/3},{1/4},...}, which have limit points 1 and 0, respectively, and so the outer or superior limit is the set {0,1} of these two points. However, there are no limit points that can be taken from the {Xn} sequence as a whole, and so the interior or inferior limit is the empty set {}. So, as in the previous example,
  • lim sup Xn = {0,1}
  • lim inf Xn = {}
However, for {Yn} = {{0},{1/2},{2/3},{3/4},...} and {Zn} = {{1},{1/2},{1/3},{1/4},...}:
  • lim sup Yn = lim inf Yn = lim Yn = {1}
  • lim sup Zn = lim inf Zn = lim Zn = {0}
In each of these four cases, the elements of the limiting sets are not elements of any of the sets from the original sequence.
  • For example, an LTI system that is the cascade connection of several stable systems with an undamped second-order LTI system (i.e., zero damping ratio) will oscillate endlessly after being perturbed (e.g., an ideal bell after being struck). Hence, if the position and velocity of this system are plotted against each other, trajectories will approach a circle in the state space. This circle, which is the Ω limit set of the system, is the outer limit of solution trajectories of the system. The circle represents the locus of a trajectory corresponding to a pure sinusoidal tone output; that is, the system output approaches/approximates a pure tone.

Generalized definitions

The above definitions are inadequate for many technical applications. In fact, the definitions above are specializations of the following definitions.

Definition for a set

The limit inferior of a set XY is the infimum of all of the limit points of the set. That is,

\liminf X�:= \inf \{ x \in Y�: x \text{ is a limit point of } X \}\,

Similarly, the limit superior of a set X is the supremum of all of the limit points of the set. That is,

\limsup X�:= \sup \{ x \in Y�: x \text{ is a limit point of } X \}\,

Note that the set X needs to be defined as a subset of a partially ordered set Y that is also a topological space in order for these definitions to make sense. Moreover, it has to be a complete lattice so that the suprema and infima always exist. In that case every set has a limit superior and a limit inferior. Also note that the limit inferior and the limit superior of a set do not have to be elements of the set.

Definition for filter bases

Take a topological space X and a filter base B in that space. The set of all cluster points for that filter base is given by

\bigcap \{ \overline{B}_0�: B_0 \in B \}

where \overline{B}_0 is the closure of B_0. This is clearly a closed set and is similar to the set of limit points of a set. Assume that X is also a partially ordered set. The limit superior of the filter base B is defined as

\limsup B�:= \sup \bigcap \{ \overline{B}_0�: B_0 \in B \}

when that supremum exists. When X has a total order, is a complete lattice and has the order topology,

\limsup B = \inf\{ \sup B_0�: B_0 \in B \}

Proof: Similarly, the limit inferior of the filter base B is defined as

\liminf B�:= \inf \bigcap \{ \overline{B}_0�: B_0 \in B \}

when that infimum exists; if X is totally ordered, is a complete lattice, and has the order topology, then

\liminf B = \sup\{ \inf B_0�: B_0 \in B \}

If the limit inferior and limit superior agree, then there must be exactly one cluster point and the limit of the filter base is equal to this unique cluster point.

Specialization for sequences and nets

Note that filter bases are generalizations of nets, which are generalizations of sequences. Therefore, these definitions give the limit inferior and limit superior of any net (and thus any sequence) as well. For example, take topological space X and the net (x_\alpha)_{\alpha \in A}, where (A,{\leq}) is a directed set and x_\alpha \in X for all \alpha \in A. The filter base ("of tails") generated by this net is B defined by

B�:= \{ \{ x_\alpha�: \alpha_0 \leq \alpha \}�: \alpha_0 \in A \}.\,

Therefore, the limit inferior and limit superior of the net are equal to the limit superior and limit inferior of B respectively. Similarly, for topological space X, take the sequence (x_n) where x_n \in X for any n \in \mathbb{N} with \mathbb{N} being the set of natural numbers. The filter base ("of tails") generated by this sequence is C defined by

C�:= \{ \{ x_n�: n_0 \leq n \}�: n_0 \in \mathbb{N} \}.\,

Therefore, the limit inferior and limit superior of the sequence are equal to the limit superior and limit inferior of C respectively.

See also

References

In-line references
  1. ^ a b Goebel, Rafal; Sanfelice, Ricardo G.; Teel, Andrew R. (2009). "Hybrid dynamical systems". IEEE Control Systems Magazine 29 (2): 28–93. doi:10.1109/MCS.2008.931718. 
  2. ^ Halmos, Paul R. (1950). Measure Theory. Princeton, NJ: D. Van Nostrand Company, Inc.. 
General references
  • Amann, H.; Escher, Joachim (2005). Analysis. Basel; Boston: Birkhäuser. ISBN 0817671536. 
  • González, Mario O (1991). Classical complex analysis. New York: M. Dekker. ISBN 0824784154.